Geometry of isophote curves. 

Andre DIATTA and Peter J. GIBLIN 

Abstract 

We consider the intensity surface of a 2D image, we study the 
evolution of the symmetry sets (and medial axes) of 1-parameter fam- 
ilies of iso-intensity curves. This extends the investigation done on 
1-parameter families of smooth plane curves (Bruce and Giblin, Gib- 
lin and Kimia, etc.) to the general case when the family of curves 
includes a singular member, as will happen if the curves are obtained 
by taking plane sections of a smooth surface, at the moment when the 
plane becomes tangent to the surface. 

Key words and phrases: Isophote curve, symmetry set, medial axis, 
D | skeleton, vertex, inflexion, shape analysis. 
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1 Introduction 



Image data is often thought of as a collection of pixel values I : Z 2 i— > Z + . 
The physical information is better captured by embedding the pixel values in 
the real plane, as the pixelation and quantization are artifacts of the camera, 
hence I : R 2 i— > R + . The geometrical information of an image is even better 
captured looking at the level sets I(x) = I , for all J G R + , that is, looking 
at the isophote curves of the image. 

Shape analysis using point-based representations or medial representa- 
<3\ \ tions (such as skeletons) has been widely applied on an object level demand- 
ing object segmentation from the image data. We propose to combine the 
object representation using a skeleton or symmetry set representation and the 
appearance modelling by representing image information as a collection of 
medial representations for the level-sets of an image. As the level Jo changes, 
the curves change like sections of a smooth surface by parallel planes. 
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The qualitive changes in the medial representation of families of isophotes 
fall into two types: (1) those for which the isophotes remain nonsingular (see 
for example [3J, [TTJ) and (2) those for which one isophote at least is singular. 
The symmetry set (SS) of a plane curve is the closure of the set of centres of 
circles which are tangent to the curve at two or more different places. The 
medial axis (MA) is the subset of the SS consisting of the closure of the locus 
of centres of circles which are maximal, (maximal means that the minimum 
distance from the centre to the curve equals the radius). Our aim is to extend 
the investigation to the case (2) when the family includes singular curves, as 
is the case when one of the plane sections is tangent to the surface so that 
this section is a singular curve. The final goal is to represent image smooth 
surfaces by the collection of all medial reprentations of isophotes, forming a 
singular surface in scale space. 

In this article, which is theoretical in nature, we work with the full SS, and 
consider the transitions which occur in the SS of a family of plane sections of 
a generic smooth surface in 3-space, as the plane moves through a position 
where it is tangent to the surface. We investigate the local geometry of these 
families of curves and track the evolution of some crucial features of the SS 
and MA. In particular, we will trace and classify the patterns of some special 
points, on the sections of a surface as the section passes through a tangential 
point, such as vertices (maxima and minima of curvature), inflexions, triples 
of points where a circle is tritangent and the pattern of the centre of such a 
circle, paires of points where a circle is bitangent with a higher order contact 
at one of them, etc. The vertices are crucial to the understanding of the 
SS since it has branches which end at the centres of curvature at vertices. 
From the way in which vertices behave we can deduce a good deal about 
the evolution of the SS and its local number of branches. The inflexions 
correspond to where the evolute of the curve, recedes to infinity. We also 
classify all possible scenarii of how vertices and inflexions are distributed 
along the level curves. 

Last, we produce examples of SS and MA illustrating the cases. 

We are concerned with the local behaviour of symmetry sets (SS) and 
medial axis (MA) of plane sections of generic@ smooth surfaces so we may 
assume that our surface M is given by an equation z = f(x, y) for a smooth 
function /, which will often be assumed to be a polynomial of sufficiently 
high degree. We shall take M in Monge form, that is /, f x and f y all vanish 
at (0,0). 

Acknowledgements This work is a part of the DSSCV project supported by 
the 1ST Programme of the European Union (IST-2001-35443). The authors are 

2 The genericity conditions will vary from case to case. See [§]. 
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Figure 1: Two plane sections of a torus close to a singular section, together 
with their evolutes. The thick lines are the MA and the dashed lines are 
the additional parts of the SS. As the two ovals merge, two cusps on the 
evolute recede to infinity, taking the branches of the SS with them. (In the 
right-hand figure, in fact the SS goes twice to infinity and in between these 
excursions it covers the whole vertical line; this part, caused by the global 
structure of the curve, has been omitted for clarity. In this paper we are 
concerned with the local behaviour of SS near the singular section.) 

also grateful to Prof. Mads Nielsen and Dr. Aleksander Pukhlikov for useful 
discussions. 

2 Intrinsic geometry of generic isophote curves 

This section describes the geometry of isophote curves evolving on a fixed 
smooth surface M, under a 1-parameter family of parallel plane sections. 
Namely, we shall examine closely the different configurations of vertices and 
inflexions on the sections on our surface. We will in particular concentrate 
on the evolution through a plane section which is tangent to M at a point p, 
so that this section is singular. For a generic surface, three situations arise, 
according to the contact between the tangent plane and M at p, as measured 
by the singularity type of the height function in the normal direction at p. 
See for example [T5] for the geometry of these situations, and jU [T_3] for an 
extensive discussion of the singularity theory. 

• The contact at p is ordinary ('Ai contact'), in which case the point is (i) 
elliptic or (ii) hyperbolic. The intersection of M with its tangent plane at p 
is locally an isolated point or a pair of transverse arcs. 

• The contact is of type A 2 , which means that p is parabolic. The inter- 
section of M with its tangent plane at p is locally a cusped curve. 

• The contact is of type A%, which means that p is a cusp of Gauss, in which 
case it can be (i) an elliptic cusp, or (ii) a hyperbolic cusp. The intersection 
with the tangent plane is locally an isolated point or a pair of tangential arcs. 
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Elliptic and hyperbolic points occupy regions of M, separated by parabolic 
curves which are generically nonsingular; on the parabolic curves are isolated 
points which are cusps of Gauss. 

The following gives a complete description of the behaviour of vertices 
and inflexions on isophotes curves near a singular point. 

Theorem 1. Let f = k be a section of a generic surface M by a plane close 
to the tangent plane at p, k = corresponding with the tangent plane itself. 
Then for every sufficiently small open neighbourhood U ofp in M, there exists 
e > such that f — k has exactly v(p) vertices and i(p) inflexions lying in 
U, for every < \k\ < e, where v(p) and i(p) satisfy the following equalities. 

(E) // p is an elliptic point, then for one sign of k the section is locally 
empty; in the non-umbilic case, for the sign of k yielding a locally 
nonempty intersection we have r(p) = 4, I(p) = 0. Likewise if p is an 
umbilic point, then v(p) = 6, I(p) = 0. 

(H) If p is a hyperbolic point, v(p) satisfies one of the following. We use 
«-> to indicate the transition in either direction, m + n indicating the 
numbers of vertices on the two branches of f = k for one sign ofk before 
the <-> and for the other sign of k after it. In the most generic case 
( open regions of our surface ) we have 2 + 2 «-> 2 + 2 or 1 + 1 <-> 3 + 3. See 
Figured In other cases, occurring along curves or at isolated points of 
our surface, we can have in addition 3 + 2 <-> 2 + 1 or 3 + 1 <-> 2 + 2. Also 
using the same notation, i(p) satisfies: 1 + 1 ^0 + 2 or 1 + 2^0 + 1. 
There are 8 cases in all, and the full list is given in J2J/. 

(P) If p is a parabolic point but not a cusp of Gauss, v(p) = 3, I(p) = 2. 

(ECG) If p is an elliptic cusp of Gauss, v(p) = 4 , I(p) = 2 for one sign of 
k, and v(p) = I(p) = for the other. 

(HCG) If p is a hyperbolic cusp of Gauss, v(p) satisfies 1 + 3 ^4 + 4 or 
2 + 2^4 + 4, whereas I(p) satisfies 2 + 2<->0 + 2 ; l + l<->0 + or 
1 + 1^0 + 4. 

For the proof and more details see [8], [9]. 

3 Symmetry sets (SS) and medial axes (MA) 
of isophote curves 

The SS of a smooth simple closed curve in M. 2 is made of piecewise smooth 
curves (locus of Afs), triple crossings (Af), cusps (AiA 2 ), endpoints (A 3 ) 
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Figure 2: Arrangements of vertices and inflexions on the level sets of /, in the 
most generic hyperbolic case (called Hi in [9j). See Theorem [TJ In each case, 
we show, above, the vertex and inflexion curves — that is, the loci of vertices 
and inflexions on the level sets of / — and, below, a sketch of the level curves 
for / < 0, / > 0, showing the positions of these vertices and inflexions. 
Thick lines: / = or / = k; thin solid lines: vertex curves; dashed lines: 
inflexion curves. Open circles: minima of curvature; solid circles: maxima of 
curvature; squares: inflexions. 



and the points at 'infinity' (they correspond to bitangent lines to the curve). 
See Fig El 

• A\: The centres of bitangent circles with ordinary tangency at both 
points. 

• A\: The centres of tritangent circles with ordinary tangency at all 
points. They are the triple crossings on the symmetry set. 

• AiA 2 : They are the centres of bitangent circles which are osculating 
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circles at one point of the curve and have an ordinary tangency at the other 
point. They lie on the evolute and are cusps on the symmetry set. 

• A3: They are the centres of circles of curvature at extrema of curvature 
on the curve, the endpoints of the symmetry set and the cusps on the evolute. 

• Bitangent lines: the circle now has its centre at infinity so the SS goes 
to infinity. 




Figure 3: (a)-(e): Illustration of the circles whose centres contribute to the 
symmetry set. (a) is an Af, (b) an AiA 2 , (c) an A\, (d) an A3 and (e) a 
centre at 00 (bitangent line). In the last case the circle has become a straight 
line and the centre is at infinity. Right: a schematic drawing of a tritangent 
circle and a level set / = k for an umbilic point at the origin O. As k — > 
the points of tangency trace out three curves which we call the l A\ curves'. 
Calculation of these curves is given in §3.11 Once these curves are known we 
can calculate the locus of centres of the tritangent circles. 

At inflexions the evolute goes to infinity and the sign of curvature changes. 
Thus a positive maximum of curvature will be followed by a negative mini- 
mum, which in terms of the absolute value of curvature is again a maximum. 

Our approach to the study of SS of families of curves which include a 
singular curve is to trace the A3 points, the inflexions, the A\A 2 points 
and the A\ points on the curves as they approach the point at which the 
singularity develops. In this way we obtain significant information about the 
SS themselves. The patterns of vertices and inflexions have been studied in 
detail and for all the relevant cases in [18J and in [9], as recalled in Section [2] 
Subsection 13. II and 13.21 are devoted to the study of the locus of A\ and A\A 2 
points, respectively. In Subsection 13.31 we derive information on the changes 
on the SS of families of isophotes curves. 

3.1 A\ points 

The A\ points are the centres of circles which are tangent (ordinary tangency) 
to / = k (for any choice of /, such as hyperbolic or umbilic) at three distinct 
points. They occur at triple crossings on the SS. Instead of looking directly 
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for the centres of those tritangent circles, we rather first look for the points 
where those circles are tangent to the curve f — k (see Fig. [31 right, for a 
schematic picture of the umbilic case). Thus we expect to have three curves, 
the l A\ curves', having the origin as their limit point, along which the three 
contact points move. First, we want to find the limiting directions of these 
curves, ie the lines they are tangent to as k — > 0. After finding the limiting 
directions, we can then determine enough of a series expansion (possibly a 
Puiseux series) to decide how the A\ curves lie with respect to the vertex 
curves, etc. which we have determined before. We will give an example of 
such a parametrization below. 

The equations which determine the A\ curves are of course highly non- 
linear. They are in fact 8 equations in 9 unknowns, thereby determining an 
algebraic variety in M. 9 which, when projected onto suitable pairs of coordi- 
nates, gives each A\ curve in turn. There are two important features of these 
equations: 

• Naturally they are symmetric in that the contact points can be permuted; 

• The equations inevitably admit solutions obtained by making two of the 
tangency points coincide ('diagonal' solutions). This causes the algebraic va- 
riety in M 9 to have components of dimension greater than 1 which we want 
in some way to discard. 

We now set up the equations. Any circle has the form C(x, y) = where 

C = x 2 + y 2 + 2ax + 2by + c, 

so that the centre is (—a, —b) and the radius is r where r 2 = a 2 + b 2 — c. 
However we prefer the parametrization by (a, b, c) rather than (a, b, r) since 
it results in equations which are linear in the parameters. 

Let this circle be tangent to / = k at the three points = (xi,yi), 
i = 1,2, 3. There are 8 equations Fj — 0, j — 1, ... ,8 which connect the 9 
unknowns Xi, y^ a, b, c. 

Fx := f(xx,yi) - f(x 2 ,y 2 ), 
F 2 ■= f(xi,yi) - f(x 3 ,y 3 ), 
F i+2 := xf + y 2 + 2axi + 2b Vi + c, i = 1, 2, 3, 

F i+5 ■= a^(x i} yi) -bj£(xi,yi) +x i ^(x i ,y i ) -y^x^yi), i = 1,2,3. 

The meaning of the 8 equations is as follows. 

eqi. F\ = pi and P2 in the same level curve of /; 
eq 2 '■ F 2 = pi and P3 in the same level curve of /; 
eqi +2 : F i+2 = pi lies on the circle C, i = 1, 2, 3; 
eq i+5 : F i+5 = C and the level set of / through p, are tangent at p^. 
First from the three equations eqi, i = 3,4,5, we can get a, b and c as 
functions of Xi,yi. Of course this is merely finding the circle through three 



7 



given points, which need to be non-collinear, and in particular distinct, for 
a unique solution. More details about this will appear elsewhere. 

Remark In the umbilic case, we can always rotate the coordinates to make 
b = 6 2 in the expression of f(x,y), as shown in [TU]. Thus, from now on 
we assume b = 6 2 for an umbilic point. Once having assumed b = 6 2 > 
we now make the genericity assumption that b\ 7^ 63. We shall also look for 
solutions for these equations for which the limiting directions (limiting angles 
to the positive x-axis) are distinct. This relates to the point made earlier, 
that our equations inevitably admit 'diagonal' solutions which we want to 
suppress. Thus we are assuming here that the limiting directions of the three 
A\ contact points of our tritangent circle are distinct as the oval f(x,y) = k 
shrinks to a point with k — ■> 0. 

Proposition 1. Generically, there are no triple crossings, nor cusps on the 
local branches of the symmetry set of isophotes curves near a hyberbolic point. 

The limiting directions of the A\ curves at an umbilic, making the as- 
sumptions in the above Remark, are at angles £1,^2, £3 equal, in some order, 
to 90°, —30°, —150° to the positive x-axis, or the 'opposites' of these, namely 
—90°, 150°, 30°. This suggests strongly that there are always two triples of 
A\ contact points tending to the origin as k — > 0. 

Proposition [I] implies, as confirmed by experimental evidence (see Fig. 
E]), that there are in fact two triple crossings (Af) in the symmetry set in 
the umbilic case. The proof of the Proposition is an explicit computational 
of the tangent cone of the algebraic variety defined by the above equations 
Fi = 0, i = 1...8. The branches (xi,yi) corresponding to (ti,t 2 ,t 3 ) = 
(90°, -30°, -150°) have the form 
((-2Mo - Qb b 3 + 3c 3 + Cl )t 2 /6(& 3 - 61) + • • • , t), 
{\>/Zt + . . . , -\t + . . .) and (-|\/3t + • • • , -\t + . . •) 

The actual locus of A\ points (triple intersections) on the symmetry set 
close to an umbilic point where b = b 2 as above and b\ 7^ 63, is (— a(t), —b(t)) 
where 

a(t) = !ft 2 + ^(7& &i + 9b b 3 - 3ci - c 3 )t 3 + h.o.t. 

b(t) = §(&i + 36 3 )t 2 + ±{b\ + 3M 3 + 46g + 5c 4 - c 2 - 3c )t 3 + h.o.t. 

Generically this curve has an ordinary cusp at the origin. 

3.2 A X A 2 points 

The AiA 2 points are the centres of bitangent circles which are osculating 
at one point and have an ordinary tangency at the other one; they produce 



3 This computation, like all those underlying this article, was performed in Maple. 
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cusps on the symmetry set. As in the case of A\ points ( §3.11) . we look in the 
first instance for the points where those circles are tangent to the level sets 
of/- 

We find these curves by taking the circle C to have equation x 2 + y 2 + 
ax + by + c = as in §3.11 This time after elimination of a, b, c we obtain 
3 equations in 4 unknowns instead of 5 equations in 6 unknowns. Let the 
circle C be tangent to the same level set / = k at the two points p, = 
(xi,yi), i = 1,2. We proceed to write down the corresponding conditions, 
defining functions Fi as follows. 

^i : = f(.Xi,Vi) - /(^2,2/2), 

F 2 := 2a(x 1 - x 2 ) + 2b(y 1 - y 2 ) + x\ + y\ - x\ - y 2 , 

F 3 := af y (x u y x ) - bf x (x 1} yx) + x 1 f y {x 1 , y x ) - yxf x {x x , y 1 ), 

F 4 := af y {x 2 ,y 2 ) -bf as (x 2 ,V2) +x 2 f y (x 2 ,y 2 ) - y 2 f x (x 2 , y 2 ), 

F 5 := (a + x 2 )(f xx f 2 - 2f xy f x f y + f yy f 2 ) - f x (f 2 + f 2 ) (derivatives at (x 2 ,y 2 ). 

We have the corresponding equations and their interpretations: 



eq 1 : 


Fi 


= 


Pi and p 2 are in the same level set of /; 


eq 2 ■ 


F 2 


= 


a circle with centre (—a, —b) passes through p x and p 2 ; 


eq 3 ■ 


F 3 


= 


this circle is tangent to the level set of / through pi; 


eq 4 : 


F, 


= 


this circle is tangent to the level set of / through p 2 ; 


e<? 5 : 


F, 


= 


this circle is the circle of curvature of the level set through 



We solve eq 2 ,eq 3 for a and b and substitute in eq 4 and eq$. We summarize 

the results as follows. See Figure HI We assume as before that the limiting 
angles at which the A\ and A 2 points approach the origin are distinct. 

Proposition 2. Generically, there are no cusps on the local branches of the 

symmetry set of isophotes curves near a hyperbolic point. The limiting angles 

in the umbilic case must be one of the following. 

A Y : -30°, A 2 : 90°; or A x : 150°, A 2 : -90°; 

Ax : -150°, A 2 : 90°; or A x : 30°, A 2 : -90°; 

A\ : 60°, A 2 : —120° or vice versa; 

A\ : —60°, A 2 : 120° or vice versa. 

This means that there are six cusps (A X A 2 ) on the SS in this umbilic case. 
In that case, we expect each cusp (which requires an A\ and an A 2 contact) 
to use one of the above six solutions, for a definite choice of A\ and A 2 in 
the last two cases. 

3.3 Symmetry Sets (SS) and Medial Axes (MA) 

As suggested by Theorem [1], Propositions [2] and [2, the local structure of the 
SS and MA of individual isophote curves and its transitions are as follows: 
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Figure 4: The possible limiting directions of Ai and A 2 contact points of 
A\A 2 circles, in the umbilic case with axes rotated so that bo = b 2 , assuming 
the limiting directions are unequal. Those labelled 1 are only A\ directions 
and similarly for A 2 . The unlabelled directions can be either, with A\ and 
A 2 at 180° to one another. 

• parabolic points: the local structure of SS is just 3 separate branches 
correponding to the 3 vertices separated by inflexions (Theorem [T]), see Fig. 

E 

• nonumbilic elliptic points: the SS is made of just 2 transverse arcs, one 
joining two centres of curvature at maxima of curvature and the other one 
two minima of curvature. The SS will look like itself and disappear as the 
curve shrinks to a point. 

• hyperbolic point: the SS and MA are made of smooth branches, which 
do not connect together to form cusps or crossings. This implies in particular 
that generically, the SS (and MA) is just given by the geometry of vertices 
and inflexions as well as how they are distributed along the isophote curves, as 
described in Section [2J The branches of the SS will start at endpoints which 
are the centres of curvature of the isophote curves at vertices and they point 
towards the corresponding vertex if the isophote curve has a local minimum 
of curvature, and away from the vertex where the curve has a maximum of 
curvature. 

• near umbilics: the SS have generically two triple crossings and six cusps. 
Hence generically, the SS has one structure, as in Fig. E 

For the drawing of the SS and MA, we will need the pre- symmetry set 
(preSS) which is the subset of the cartesian product I x I of the parameter 
space /, defined by the pairs (s,t) corresponding to points p = -y(s) and 
q = 7(t) which contribute to the SS. That is, there is a circle tangent to 7 at 
the points 7(5) and 7(t). See Fig. E 
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Figure 5: To the left: A schematic picture of the patterns of the vertices 
(vertex set V p = 0: thin solid line) and inflexions (inflexion set I p = 0: 
dashed line) of the level curves f = k evolving through a parabolic point, 
together with the zero level set / = (thick line). The vertex set has two 
cuspidal branches and one smooth branch. The inflexion set has one cuspidal 
branch which is always below all cupidal branches and one smooth branch. 
The zero level set f p — has one cuspidal branch which is always between 
the two cuspidal vertex branches. The level set f p = k then evolves so that 
the number of vertices remains as 3 and the number of inflexions as 2 for 
both signs of k, with k small. In the middle and to the right: Symmetry 
sets (thin lines) of curves (thick lines) which are sections of a surface close to 
the tangent plane at a parabolic point. One sees 3 vertices sepated by two 
inflexions on both before and after the transition. At the transitional moment 
itself, the branches reach right to the curve, which then has an ordinary cusp. 
Figure produced with LSMP[T6]. 



11 



Figure 6: Symmetry set and pre-symmetry set of / = k, in the umbilic 
case f(x,y) = x 2 + y 2 + x 3 — xy 2 + 2y 3 and k = 0.09. The figure to the 
right is the same as the left hand side one, but the symmetry set has been 
enlarged so that the two A\ points (triple crossings) and the six A\A 2 (cusps) 
are more visible. One can also see the six endpoints of the symmetry set, 
corresponding to the six vertices on the curve. Varying k then the SS will 
still look like itself and disappear as k — > 0. This figure illustrates the results 
of Proposition [JJ and Proposition [2J 

4 Evolution of symmetry sets of isophote curves 
in 1-parameter families of surfaces 

As explained in Section [21 given a generic surface M, elliptic and hyperbolic 
points occupy regions of M, separated by parabolic curves with isolated 
points on them which are cusps of Gauss. We can then consider moving from 
a hyperbolic point to a parabolic point of M. We can also realise this by 
evolving the surface in a 1-parameter family, of the form z = x 2 — a 2 y + 
box 3 + b\x 2 y + b 2 xy 2 + b%y 3 + where a — > and 6 3 ^ 0. It turns out 
that, generically, the only hyperbolic points which exist sufficiently near a 
parabolic point are the ones corresponding to vertex transition 1 + 1^3 + 3 
in Theorem [TJ The Figure [7] shows how the vertices behave on a 2-parameter 
family of plane sections near the tangent plane at a hyperbolic point, evolving 
to a family of sections near a parabolic point. 



12 




Figure 7: Transition of the patterns of vertices (thick curve) and inflexions 
(fin curve) on a 2-parameter family of plane sections f a = k near the tangent 
plane at a hyperbolic point, evolving to a family of sections fo = k near a 
parabolic point. f(x,y) = x 2 — a 2 y 2 + x 3 + 2x 2 y — xy 2 + y 3 . (a) a = 1 
(hyperbolic); the vertex set has 4 branches and the inflexion 2. (b) a = 0.3, 
the top part (above x-axis) of two vertex branches join together to form a 
loop which is shrinking to the origine as a — > 0. The vertex branch tangent 
to x = stays smooth. The other vertex branch bend to become a cusp, 
(c) a = 0.05: the vanishing loop, (d) As a — > 0, the inflexion set exchanges 
branches: the top part (above x-axis) join together to make a smooth branch, 
whereas the bottom part form a cusp below the cuspidal vertex branches. 
Compare Figures [2] and El 

5 Conclusion 

This paper represents a step towards understanding the evolution of SS and 
MA of families of isophote curves, or more generally of families of plane 
sections of s generic surface in 3-space. The evolution of the MA depends, in 
an essential way, upon the underlying evolution of the SS [T3] , which is why 
we have concentrated on the SS in this paper. An interesting follow up of 
this work, would be to combine into a more global represention of an image 
by the collection of those individual representations, as a singular surface in 
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scale space, whose sections are the individual SS and MA. 
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